A Stackelberg Strategy for Routing Flow over Time 

Umang Bhaskar* Lisa Fleischer* Elliot Anshelevich^ 



Abstract 

Routing games are used to to understand the impact of individual users' decisions on network effi- 
ciency. Most prior work on routing games uses a simplified model of network flow where all flow exists 
simultaneously, and users care about either their maximum delay or their total delay. Both of these mea- 
sures are surrogates for measuring how long it takes to get all of a user's traffic through the network. We 
attempt a more direct study of how competition affects network efficiency by examining routing games 
in a flow over time model. We give an efficiently computable Stackelberg strategy for this model and 
show that the competitive equilibrium under this strategy is no worse than a small constant times the 
optimal, for two natural measures of optimality. 
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1 Introduction 



In routing games, players route a fixed amount of flow in a network. A player suffers a cost, which depends 
on its routing and the routing chosen by the other players. A flow in a routing game is an equilibrium flow 
if no player can choose a different routing and reduce its cost. 

Routing games model a variety of problems, including routing on roads [3l[32l, computer networks iflOl 
EUHH, and scheduling tasks on machines [22 J. For many measures of the quality of a routing, the equi- 
librium in routing games is known to be inefficient compared to a routing which optimizes the measure. 
This inefficiency is quantified by the price of anarchy ll25l : the worst ratio of the objective evaluated for 
the equilibrium flow, to the optimal flow. There is considerable interest in obtaining bounds on the price of 
anarchy in routing games. 

Players in a routing game have a bottleneck objective if a player's cost is the maximum delay on the 
edges it uses [5]. The bottleneck objective models applications where a player's cost depends largely on the 
performance of the worst resource it uses. This objective ignores the effect of delay on edges besides the 
bottleneck edge, which can lead to the counterintuitive situation where players fail to distinguish between 
two strategies which have the same bottleneck, but have considerably different delays. This behavior may 
result in an unbounded price of anarchy, e.g., (UHKlOl. In many of these bad instances, the price of anarchy 
would be 1 if player costs depended on edges besides the bottleneck edge. Models where a player takes into 
account the delays on all edges have an improved price of anarchy ifTOl . 

Even models where a player's cost is an aggregation of the cost on each edge assume that the flow is 
static: every edge has flow on it instantaneously and simultaneously and, once established, a flow continues 
indefinitely. However, the flow in networks is often transient. Flow enters a network, uses it for some time, 
and then exits, and the flow on an edge changes with time. 

This time- varying nature of flows is captured by flows over time, introduced in lfl4l . In this model, flow 
traverses the path in finite time, and exits the network at the sink. Thus, the flow on each edge of the network 
varies with time. Every edge has a capacity which limits the flow rate on the edge. 

We consider routing games for flows over time. Every player controls infinitesimal flow, and in contrast 
to previous models where users care about either their maximum delay or their total delay, in our model the 
cost of a player is the time at which it arrives at the sink. A player's strategy is a path from the source to 
the destination. On every edge, the flow follows first-in, first-out (FIFO). While the network is capacitated, 
the model allows the inflow on an edge to be larger than the capacity of the edgdl The excess flow forms 
a queue at the tail of the edge, and must wait for the preceding flow to exit before it can exit the edge. 
Although the capacities and the edge-delays are fixed, the total delay on an edge varies with the size of the 
queue on the edge. The queue size seen by flow arriving at the edge varies with time; hence the total delay 
along any path varies with time. 
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Figure 1 : Flow in excess of capacity on an edge forms a queue at the tail 

This game, which we call a temporal routing game, follows the model of selfish routing of flows over 
time used in ll20l . The model possesses a number of interesting characteristics. It follows FIFO, which is a 
standard assumption in traffic routing literature. The model is based on dynamic queueing, first used in [33]. 

"•"Thus, unlike the static flow model considered in 1111 . the ability to reduce capacities is not sufficient to enforce the optimal 
flow. 
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Further, the equilibrium flow over time can be characterized in terms of special static flows l20l . described 
in El 

In flows over time, similar to static flows, various objectives may be used to compare the performance 
of the equilibrium flow to the optimal flow. A natural objective is the total delay: the sum of the costs of 
the players. The flow which minimizes the total delay is the earliest arrival flow, which maximizes the 
flow that arrives at the destination by time 9, for every time 9. We call the ratio of the total delay of the 
worst equilibrium flow to the total delay of earliest arrival flow the total delay price of anarchy. A different 
objective is the time taken to route a fixed amount of flow to the sink. This is called the completion time, 
and is minimized by a quickest flow. The earliest arrival flow is also a quickest flow. The ratio of the time 
taken by the worst equilibrium flow, to the time taken by the quickest flow to route a fixed amount of flow is 
called the time price of anarchy. A third objective is the amount of flow that reaches the destination by time 
9. The ratio of amount of flow which reaches the destination by time 9 in the worst equilibrium flow to the 
amount of flow which reaches the sink in the earliest arrival flow is called the evacuation price of anarchy. 

In the Stackelberg model introduced in [31], different players in a game have different priorities. A 
leader picks a strategy first, and then the followers pick their strategies. Importantly, the leader commits to 
a strategy before the followers pick theirs. In their 1982 book on noncooperative game theory @, Basar 
and Olsder describe a general form of Stacklberg games where players may have different strategy spaces. 
We embrace this general definition. In our setting, the network manager is the leader. Given some physical 
limit on the capacity of each edge, the network manager acting as leader picks a capacity for each edge 
which does not exceed this physical limit. The remaining players, acting as followers, then pick a route 
from source to sink as their strategy. 

Our Contribution. We study the equilibrium flow in temporal routing games. We show that small con- 
stant bounds on the efficiency loss of equilibrium flow in temporal routing games can be enforced. In 
particular, 

• We give a polynomial-time computable Stackelberg strategy to enforce a bound of e/(e — 1) on the 
time price of anarchy in temporal routing games; and 

• We show the same strategy also enforces a bound of 2e/(e — 1) on the total delay price of anarchy. 
The strategy we describe is based on the following key result. 

• In temporal routing games where the edge capacities satisfy certain properties with respect to the 
quickest flow, the time price of anarchy is bounded by e/(e — 1). 

The bound of e/(e — 1) on the time price of anarchy stated above is tight, as there is a matching example 
in ll20l . Our results are in sharp contrast to two previous results. In [20], the authors show that the evacuation 
price of anarchy is ©(log n), where n is the number of vertices. Further, ll23l considers the maximum time 
taken by any player to travel through the network. They show that for this objective, the price of anarchy is 

fl(n). 

We restrict our analysis to single-source, single-sink networks with constant inflow. In this case, the 
quickest flow is known to be a temporally repeated flow (see There are variable inflows for which this 
is not true. Equilibrium for temporal routing games with a single source and single sink exist [20). Further, 
in settings with constant inflow, they can be described in terms of static flows with special properties (20). 
These properties are crucially used in our proofs. 
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Related Work. For selfish routing of static flows, the literature is vast; see (7J|26l|32l for early results on 
the equilibrium in selfish routing. The term price of anarchy was first used in ll25l to describe the efficiency 
loss caused by the absence of a controlling authority. Since then, the price of anarchy has been widely used 
as a measure of how system performance degrades if resources are used selfishly. For results on the price of 
anarchy for static flows, see li28l . 

Stackelberg strategies have been used in computer science literature to manage the efficiency loss at 
equilibrium |[2T1 l27l |29l . Here, the network manager is a player with flow which she routes with the ob- 
jective of reducing efficiency loss. Coordination mechanisms, introduced in [8 ], refer to a choice of system 
parameters by the designer to influence equilibria. The term is used to describe situations both where the 
system parameters are chosen before the market power of the players is known, and where the market power 
of the players is known beforehand. In the latter situation, this concept fits within the notion of a Stackelberg 
game as defined by Basar and Olsder 0. Our approach in this paper may also be viewed as a coordina- 
tion mechanism with the market power of players known. Coordination mechanisms and related results are 
further discussed in |9l . 

Ford and Fulkerson lfl4l introduce flows over time. They consider the problem of maximizing the 
amount of the flow which can be sent from a source s to a destination t by a given time T; the flow which 
achieves this is called the maximum dynamic flow. A related problem is the quickest flow problem: find 
the dynamic flow which routes a fixed amount of flow M from s to t in minimum time. The earliest 
arrival flow problem generalizes the maximum flow and the quickest flow problems. For a single source and 
destination, earliest arrival flows exist lfl~5l . however the flow over time obtained may have a description of 
size exponential in the size of the input [34]. These and other problems on flows over time are considered 

m canainiiisoa. 

Temporal routing games are analyzed by Koch and Skutella in [20] and are based on deterministic 
queueing models used earlier in traffic simulation I1301I331 . The authors in [20 ] show that if all edges have 
zero delay, the time price of anarchy is 1. In contrast, they show the evacuation price of anarchy is ©(log n). 
Macko et al. study the existence of Braess's paradox in temporal routing games l23l . They show that the 
maximum delay suffered by any player can be arbitrarily worse than for an optimal flow over time which 
minimizes the maximum delay. Anshelevich and Ukkusuri [4] analyze a different discrete-time model of 
selfish routing. In their model, the delay of an edge e at any timestep t is a function of the flow entering the 
edge at t and the history of the edge, which is an encoding of the flow entering the edge in timesteps before 
t. However, in their model, edges are uncapacitated; and in instances with multiple sources and sinks, the 
equilibrium may not exist. In single-source, single-sink instances an equilibrium exists and can be computed 
efficiently. However the time price of anarchy may be large. Hoefer et al. lfT6l consider a different model 
where they consider flow controlled by players as tasks and edges as machines. A player's task corresponds 
to a significant amount of flow, rather than infinitesimal as in the models discussed previously, and must be 
routed on a single path. 

2 Model, Notation and Definitions 

Let G = (V, E) be a directed acyclic graph with two special vertices s and t called the source and sink. 
Each edge in the graph has a nonnegative capacity c e and a nonnegative edge-delay d e . An s-t path in the 
graph is a sequence of edges (i>o, Wq), ■ ■ ■ , (uj, w{) such that vq = s, wi = t, W{ = V{+i and V{ / Vj for 
i ^ j. We abuse notation slightly and define d p := J2eep ^ e ^ or an y P atn P- 

Static Flows. In a directed graph G = (V, E) with capacities c e on the edges and source s and sink t, a 
static flow / is an assigment of nonnegative values f uv that satisfy f uv = for (it, v) $ E and capacity 
constraints (Q} and flow conservation © for (u, v) € E: 
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fe < c e Ve G E (1) 

Y J fuv= J^fvw Vv€V\{s,t} (2) 

u w 

The value of a static flow / is |/| = J2 V fsv A path flow f p on a path p is a flow on p of value |/ p |. For 
an acyclic graph, a static flow / can be decomposed into the sum of path flows on a set of paths V so that 
f e = YlpeV-eev \fp\ ffl - ^ e use f = {/pipeP to denote a flow decomposition of flow /, where V is the set 
of paths with strictly positive flow. 

Flows over Time. A flow over time is denoted {f + , f~) and is defined by the functions of time /+, and 

f~ v , Vu, v G V. For any time 9 G and (u, v) G" E, f£ v (9) = fuvi®) = °- For e = (u,v) <E E and time 
9 G M+, fe(9) is the rate of flow into edge e at time 9, and f e ~(9) is the rate of flow out of edge e at time 
9. A flow over time (/+, /~) is feasible if it satisfies capacity constraints and flow conservation ©; 

f-(9)<c e Ve€£,0Gl + (3) 

= XX W V«67\{ 8) i}, (4) 
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The net flow rate leaving s and entering t must be positive. 



li IB 

For a vertex «, define f+(9) := £ u fM and f~{9) := £ w W- 

The rate of flow entering an edge f£{0) may be larger than the capacity of the edge. In this case, the 
excess flow forms a queue at the tail of the edge and must wait for the flow before it in the queue, before 
it starts traversing the edge. Define the total flow entering and exiting edge e by time 9 to be F+{9) = 
Jo fe{ v )^ u an d Fe~(@) = Jo fe~{ v )dv respectively. The edge-delay d e is the time taken by flow to traverse 
the edge if there is no queue on the edge. Then Ve G E, 9 G R+, 

F-(9)<F+(9-d e ). (7) 

To ensure that flow entering an edge at any time also leaves the edge after finite time, the flow over time 
must satisy, Ve G E, 9 G R+, 

3A<oo: F+(9) <F~(9 + d e + A). (8) 

The queuing-delay q e {9) on edge e at time 9 is the minimum time flow entering the edge at time 9 must 
wait before it starts traversing the edge: 

q e (9) := min{A > : F+(9) = F'(9 + d e + A)} (9) 
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When flow leaves the queue, the time taken to traverse the edge is the edge-delay d e . The total-delay at 
e of flow entering edge e at time 9 is d e + q e {0). By ©, flow entering an edge at time 9 must allow all the 
flow which entered earlier to exit the edge before it can exit, hence flow on an edge follows FIFO. 

Flow enters the graph at the source s at a constant rate cq. The total amount of flow to be routed to the 
sink is M. The completion time is the time when M units of flow arrive at the sink. 

Optimal Flows Over Time. The maximum flow-over-time problem with time horizon T is to maximize 
the amount of the flow sent from s to t by time T. Ford and Fulkerson [14] show that the maximum 
dynamic flow can be obtained in polynomial time by computing the static flow / which maximizes (T + 
1)1/1 ~~ S e d e fe- Thus / is a minimum cost static flow with the cost of edges being the edge-delays. For 
a flow decomposition {/ p } pe -p of /, the maximum dynamic flow sends flow at rate \f p \ along path p from 
time to T — d p . Such a dynamic flow, obtained by repeating a static flow over time, is called a temporally 
repeated flow. For a maximum dynamic flow, we call the static flow repeated over time the underlying static 
flow. 

The quickest flow problem for flow M is to find the flow over time which minimizes the time taken to 
send M units of flow from s to t. The quickest flow problem can be solved by a binary search to find the 
minimum time T for a maximum dynamic flow to route at least M units of flow. Thus, the quickest flow 
problem can be solved by a temporally repeated flow. 

The earliest arrival flow problem is to find a flow over time which maximizes the flow that arrives at 
the destination by time 9, for every time 9. An earliest arrival flow is also a maximum flow-over-time and 
a quickest flow, but the converse may not be true. Thus, the earliest arrival flow may not be a temporally 
repeated flow. For a single source and destination, earliest arrival flows exist fi31 . 

Temporal Routing Games. The tuple F = (G, s, t, c, d, cq,M) forms an instance of the temporal routing 
game. Every player in this game controls infinitesimal flow. A player's cost is the time its flow arrives at 
the sink. A player's strategy is a path from s to t. We assume an arbitrary ordering on the players which 
corresponds to the order in which their flow arrives at the source. 

Lemma 1 ( 11201 ). For any edge e 6 E, the function 9 + q e {9) is monotonically increasing in 9. 

By (O, the earliest time that flow entering an edge at time 9 can exit the edge is 9 + d e + q e {9). It follows 
from Lemma Q] that in a temporal routing game, flow does not wait on an edge unless the edge has a queue. 

Equilibrium Flow. Informally, a flow over time is an equilibrium flow if every player minimizes its cost, 
given the strategies of the other players. To formalize this, for every vertex v the label function l v {9) is the 
earliest time that flow starting from s at time 9 can reach v. Thus l s (9) = 9, and 

l v {9) = min {l u (0) + d uv + q uv (l u (9))} 
(u,v)eE 

From Lemma[T]and the definition of the label functions: 
Lemma 2. For each node v G V, the function l v is monotonically increasing and continuous. 
For vertex v and time 9, define V v {9) := Since l s (9) = 9, l' s (9) = 1. 

For a fixed 9 and given the queues on the edges, the labels on all the vertices can be found in the 
following manner: l s {9) = 9 and l v {9) = oo for v ^ s. Then n — 1 times, for each e = (u, v) G E set 
l v {9) = min{/„(#), l u {9) + d uv + The correctness of the labels obtained after n — 1 repetitions 

follows from the correctness of the Bellman-Ford algorithm. 
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The shortest-path network at time 9, Gg, is the subgraph induced by the set of edges Eg = {(u, v) G 
E : l v {9) = l u {9) + d uv + q U v{lu(G))}- Flow is sent over current shortest paths if for every edge (u, v) G E 
and for all 9 G R+, if l v (9) < l u (9) + d e + q uv (l u (9)) then f+(l u (9)) = 0. 

Definition 3. Let (G, s, t, c, d, cq,M) be a temporal routing game. A flow over time (/ + , f~) is an equilib- 
rium flow if 

m v f+(ff\ = S c ° ij6 - M / c ° 

{ J ^(s,v)eEJsv^) I o otherwise ' 
( ii) flow is sent over current shortest paths, and 
(Hi) for every e £ E and 9 > 0, if q e {9) > 0, then f~(9 + d e ) = c e . 

Every temporal routing game has an equilibrium [20]. 

For a temporal routing game F, (/ + (r), f~(F)) is the equilibrium flow, and EQ(F) is the completion 
time of the equilibrium flow. If the instance is clear from context, we simply use (/ + , /~) and EQ. 

Price of Anarchy. In this paper we consider two separate objectives. In Section 0] and Section |6j our 
objective is to minimize the completion time. For this objective, the optimal flow is a quickest flow. Since a 
quickest flow can be represented as a temporally repeated static flow, we use f(F) to denote the underlying 
static flow for the quickest flow for a temporal routing game F, and T(F) to denote the completion time of 
the quickest flow. The time price of anarchy is then defined as maxp EQ(T)/T(T). If the instance is clear, 
we use / to refer to the underlying static flow and T for the completion time. 

We say the static flow underlying the quickest flow saturates every edge of the graph if for all e G E, 
f e = c e and Y2 V fsv = Co- We show that if this condition holds, then the price of anarchy is small. 

Instead of flow entering the graph at the source s at a constant rate cq, another way to think of the model 
is that all flow is present at the same time at a node s', and there is an initial edge (s', s) of capacity Co and 
delay 0. Then the arrival time at t for a player is also its delay. In Section [51 the objective is to minimize the 
total delay of a flow over time which routes a fixed amount of flow M from the source to the destination. The 
total delay of a flow over time in a temporal routing instance is the sum of the arrival times at t of the players. 
For a flow (/+, /~) and instance T with completion time T, the total delay D((f + ,f-)) = J Q T ff(6)6d9. 
In this case the earliest arrival flow is the optimal flow since it maximizes the flow at t at every time 9. For 
a temporal routing game T, let (g + (F) , g~ (F)) be the earliest arrival flow. The total delay price of anarchy 
is defined as maxr D{f+{T)J-(T))/D{g+(r),g-{T)). 

In the appendix, we give an example of a temporal routing game and its equilibrium flow. 

3 The Structure of Equilibria 

Equilibria in temporal routing games can be characterized in terms of static flows with certain properties, 
called rate flows. We use the properties of rate flows to obtain our bounds on the price of anarchy. In this 
section, we introduce some of these properties, as well as an algorithm for computing equilibria. Both rate 
flows and the algorithm we discuss are described in |[20ll . 

Rate Flows. For edge e = (v,w) G E and time 9 G R+, define x+(0) := F+(l v (9)) and x~(9) := 
F-(l w (9)). 

Theorem 4 ([20]). For a flow over time, flow is sent over current shortest paths if and only if for all edges 
and for all 9, x^iff) = x~{9). 
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Let x e {9) := x+(9). At equilibrium, it follows by integrating ((U) over time and from Theorem [4] that for 
every 9 G M+, x e (6) is a static flow in the uncapacitated network G. For 9 such that x{9) is differentiable, 

d -^ = ftuo))m do) 

For any time 9, the flow given by x e {9) on every edge is called the static flow underlying the 
equilibrium flow. Let x' e (9) := dx !jj) where the differential exists. The following theorem describes some 
properties of x'{6). For 9 G R + , define E\(Q) := {(v, w) G E : q vw {lv{9)) > 0} as the set of edges which 
have positive queues on them at time 9. 

Theorem 5 ([20]). For an equilibrium flow in a temporal routing game V = (G, s, t, c, d, cq) let 9 > be 
such that x' e {9) and l' v {9) exist for all v G V, e G E. Then {x' e {9)) e ^G g is a static flow of value cq in the 
uncapacitated graph. Further, the static flow (x' e (9)) e ^G e satisfies 

l' w {9)<l' v {9), V{v,w)eE{G e )\E l {9)withx' vw {9) = Q, 

l'J9) = max !l' v (9),^^-\ V(v,w) G E(G e ) \ E 1 (9)with x' vw > , 

( c vw J 

Ue) = <nM V(v,w)£E 1 (9). 



The static flow (x' e (9)) eeGe is called a rate flow. By flO]), x' vw {9) exists iff l' v (9) and l' w (9) exist. If at 
times 9 and 9' G IR+ the shortest-path networks and the set of edges with positive queues are the same, i.e., 
Gq = Gqi and E\{9) = E\{9'\ then the rate flow x'(9) and l' v {9) satisfy the conditions of Theorem[5]at 
time 9' as well. 

Computing Equilibria. In GUI , the authors describe an algorithm to compute equilibrium flow. The 
algorithm divides the time from 9 = to 9 = M/cq into a number of phases, with phases divided by events. 
Note that 9 = M/cq is the time the last flow leaves the source; the time this flow reaches the sink is the 
completion time. An event can be of two kinds. A queue-event occurs at time 9 if for some edge e = (u, v), 
the queue decreases to zero at time l u {9). That is, the queueing delay q e (l u (9)) = and for some 5 > 
and every < e < 5, q e (l u (6 — e)) > 0. A path-event occurs at time 9 if some edge e = (u,v) enters 
the shortest-path network at time 9, i.e., l v (9) = l u (9) + d e + q e {l u {9)) and for some 5 > and every 
< e < 5, l v {9) > l u {9) + d e + q e {l u {9)). Queue events and path events are collectively termed events. 
Note that in determining the time an event occurs, we are using the source as a frame of reference. While 
the event actually occurs at a later time 9', we say an event occurs at time 9 if flow leaving the source at time 
9 reaches the tail of the edge in the queue-event or path-event at time 9'. 

For a given instance, we order the events occurring in an equilibrium flow by the time of the occurrence 
(using the source as the frame of reference) and index them, starting from to r. The event r is a special 
event, corresponding to the last flow leaving the source, thus the equilibrium flow ends at event r. We define 
9i as the time event i occurs, and Tj := h{9i). Thus, 9 r = M/cq and r r = EQ. 

A phase is the time interval between two events. Phase i as the time between events i — 1 and i. Thus, 
time 9 is in phase i if 6>j_i < 9 < 9{. We exclude the event times 9i since the vertex labels are l v {9) and the 
static flow x{9) are not differentiable at these times. Within a phase, the shortest-path network and the set 
of edges with queues on them remain constant. Hence the rate flow x'{9) and the rate of change of vertex 
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labels l' v {9) exist and are fixed for 9 within a phase. The first phase, phase 1, is the time between 9q = and 
6\. Thus, for a phase i, we define the following notation: 

• Gi denotes the shortest-path network in phase i. 

• Q is the capacity of the shortest path network in phase i. 

• A, is the change in capacity of the shortest path network when event i occurs, thus Aj = Cj — Cj_i. 
We define Co := 0. 

Note that A, = if event % — 1 is a queue event, or % — 1 is a path event but the capacity of shortest 
path network does not change; this could happen if a minimum cut is unaffected by the edge added to the 
shortest path network in a path event. 

Since the rate of change of vertex labels l' v (9) is fixed for 9 within a phase, the vertex labels l v (9) are 
fixed linear functions of 9 within a phase; and thus within a phase l' v is well-defined for all v. Thus, we can 
define: 

• l\ := l' v {9) for any time 9 in phase i. 

• The set E\ is defined as {e = (v, w) : q e {lv(&i)) > 0}. 

• We use x\ to denote the rate flow in phase i. 

For the notation above, if the phase is clear from context, for simplicity we omit the phase. Thus the rate 
flow would be denoted by x' . 

For edge (v,w) in the shortest path network at time 9, q' vw (9) := 8( H^ (e)) . Since l w (9) = l v (9) + 
dvw + QvwQ>v(9)), Q'vwi®) = — l'v{Q)- Since the rate of change of the vertex labels is constant, we 

define for phase i: 

• If edge e = (v, w) is in the shortest-path network in phase i, define q l v J := Pj — i* , otherwise 

qi':=0. 

• For an s-t path p, we abuse notation slightly to define q l p ' := ^ eg „ q l e '. 

4 A Stackelberg Strategy for the Time Price of Anarchy 

In Section |6l we prove our main technical result: 

Theorem 6. For a temporal routing game where the static flow underlying the quickest flow saturates every 
edge of the graph, the time price of anarchy is e/(e — 1). 

In general instances of the temporal routing game where the rate of equilibrium flow may exceed the 
optimal flow on some edges, a bound on the time price of anarchy is unknown. However, in any temporal 
routing game, we show how to use Theorem |6]to obtain a simple Stackelberg strategy to enforce a bound of 
e/(e — 1) on the price of anarchy. 

Theorem 7. For a temporal routing game, let T be the time taken by the quickest flow to route all flow to 
the sink. There exists a polynomial-time computable Stackelberg strategy to enforce an equilibrium flow that 
routes all flow at the source to the sink in time at most T x e/(e — 1). 
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Proof. For a temporal routing game Y = (G, s, t, c, d, Co , M), let / be the static flow underlying the quickest 
flow. This can be computed in polynomial time by conducting a binary search to find the minimum time T 
such that the maximum dynamic flow with time horizon T gets at least M flow to the sink. 

The Stackelberg strategy is then as follows. The network manager, acting as the leader, reduces the 
capacity on each edge so that the new capacities d are the value of the static flow on each edge in T: 
Cg = f e . It is easy to see that the quickest flow remains unchanged; further on each edge with the modified 
capacities, f e saturates every edge. By Theorem[6l the price of anarchy is now bounded by e/(e — 1). □ 

Thus in any instance of the temporal routing game, by reducing the capacity of edges, the completion 
time of equilibrium flow can be bounded by e/(e — 1) times the completion time of the optimal flow. 



5 The Total Delay Price of Anarchy 

We now obtain bounds on the total delay price of anarchy of temporal routing games. The total delay price of 
anarchy is the maximum over all instances, of the ratio of total delay of the equilibrium flow to the minimum 
total delay. Since the cost of a player is the time it arrives at the sink, for a flow over time (/+, /~) with 
completion time T the total delay D((f + ,f-)) = J Q T 6 J?(0)d9. 

We first show that in temporal routing games which satisfy the same assumption as in Theorem [6l the 
total delay price of anarchy is bounded by a small constant. 

Theorem 8. For a temporal routing game where the static flow underlying the quickest flow saturates every 
edge of the graph, the total delay price of anarchy is 2e/(e — 1). 

The following lemma gives a lower bound on the total delay of the earliest arrival flow. The proof, and 
all missing proofs, are given in the appendix. 

Lemma 9. The total delay of the earliest arrival flow (g + ,g~~) with completion time T in an instance V is 
at least MT/2. 

Proof of Theorem \8\ Let EQ denote the completion time of the equilibrium flow. Then by Theorem [6l 
EQ < Tej (e — 1). The total delay of equilibrium flow (/ + , f~) is bounded by 



D((f + ,f-))= I 0f+(9)d9 



Te/e-l 

6 

Te/(e-l) 



< t — - / ftme 

e ~ 1 Jo 



< MT — - — (11) 

e — 1 

The result now follows from (fTTT) and Lemma|9] □ 

Similar to the proof of Theorem[71 Theorem[8]can be used to give a Stackelberg strategy for enforcing a 
bound of 2e/(e — 1) on the total delay price of anarchy in any general instance. 

Theorem 10. For a temporal routing game, there exists a polynomial-time computable Stackelberg strategy 
to enforce an equilibrium flow with total delay at most 2e/(e — 1) times that of the earliest arrival flow in 
the unmodified instance. 
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6 The Time Price of Anarchy 



In this section, we prove Theorem [6] We assume that on every edge, f e = c e . For a path decomposition 
{fp} p ev of / along paths p G V, by our assumption, Y. pe v h = c o- 

Conceptually, we show that for an instance F of the temporal routing game, the ratio of EQ to T is worst 
if every event either occurs at time 0, or occurs at a fixed time \i. Thus, we modify an instance F to obtain 
an instance F' where every event either occurs at time or time fi. We then obtain a bound on ^9- in this 
simpler instance. 

This conceptual view is simplified; it may not always be possible to preserve the events if we insist on 
every event occuring at either time or time /i. However, we show a bound on -^r can be obtained in F by 
following the same steps analytically: 

Step 1 : For any path p, get a lower bound on d p in terms of {6>j }r_ and the queues on the path p (Lemma[T4l). 
Step 2: Use the bound in step 1 to obtain an upper bound on ^B- in terms of the event times {#i}[ =0 and the 
queues on the edges (Lemma [T5l and Corollary [T6b- 

Step 3: Show that there is some event k < r so that if all the events before and including k happen at time 
0, and all events after k occur at the same time, then the upper bound on ^S- in this modified instance also 

bounds -^2 in the original instance (Lemma [P71). 

Step 4: Evaluate the upper bound on -S for this modified, simpler instance (Lemma [18] and Theorem [6]). 
Our first step is to show a relation between the label on t and the rate of flow into t. 

Lemma 11. Let (/ + , f~) be the equilibrium flow for a temporal routing game F with inflow cq and corre- 
sponding labels I. Then l' t (8) = — t— — -rrzf or Q £ R+- 

ft 

We first show Lemma [TT1 for a path in the graph, and then use path decompositions of x'{6) in conjunc- 
tion with (fTOl) to get the result. 



Lemma 12. Let p = (s, v i, v%, . . . , Vk) be a path in Gq. If for every pair of consecutive edges (u, v), (v, w) 

in p. fuvUO)) = fLUe)), then l' Vk {6) = -jg*M» . 

Proof of Lemma [771 Let x' and l' v be the rate flow and rate of change of labels at time 9. Let {x' p }p & p be a 
path decomposition of x' where V is the set of paths with positive flow. Instead of the graph G = (V, E), we 

consider the equilibrium flow in a graph G = (V, E) with E = E x V. Every edge a G E corresponds to 

x' 

a pair (e,p) with e G E and p G V, with capacity c a = c e -r and delay d a = d e . We obtain an equilibrium 
flow in G and show that the labels on the vertices at any time <p are the same in G and G. 

Define a modified flow over time (/ + , /~) in G as follows: fa(<f>) = / ( ^(0)f L an d fai'P) = / e ~( < / , )f L - 
Then the cumulative flow F+(<j>) := f+(0) = and similarly F~(0) := $ f-(<j>) = F~^. Thus, 

Qa(<P) = 9e(0) via (O. Since d a = d e and l s {4>) = 4>, it follows that the labels on the vertices in G for the 
flow over time (/ + , /~) are equal to the labels on the corresponding vertices in G for the equilibrium flow 
(/ + , /~), for every time <fi G R+. It is easy to verify the conditions for equilibrium flow in Definition [3] for 
(/+,/-) in G. 

We show that at time 8, l\ = jp—. in H. Since the node labels are the same for (f + , f _ ) and 
_ { fZ{h{8)) w _ _ 

(/ + , / _ ), and f£{4>) = fv{4>) f° r every vertex v and time G M+, this proves the lemma. Since (/ + , /~) 
is an equilibrium flow in G, the flow y' with y' e = x' e ^- is a rate flow in graph G at time 9. Consider a path 
p G V; there is a corresponding s-t path q in G consisting of all the edges which correspond to path p. By 
our construction, on every edge a of path q, y' a = x'. 

On consecutive edges (u,v), (v, w) in q, y' uv = l' v f~ v (l v (0)) and y' vw = l' v f^ w (l v (0))- Since y' uv = y' vw , 
it follows that f-(l v (9)) = /+,(Z„(0)). Then by Lemma[H l' t f~M0)) = f^M ))- Since this is true 
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for all paths p € V, we can sum over all these paths to obtain l' t (9)f^(l t (9)) = f^~(9) = cq. Thus in graph 
Corollary 13. For any events i, i — 1, r» — Tj_i = S£ (0j — 

Proo/ By definition, t; — Ti_i = — k(9i-i) and f^{k{9)) = <k in phase £ Thus r« — n-i = 

= it, t# = m - □ 

We use Corollary 1 13l to bound <i p in terms of {rj}^_ . 
Lemma 14. For any s-t path p, d p > r r — Ya=i U + <7p') ^( r « ~~ T i-i) ■ 

Proof. By definition of shortest path network, for any time 9 and for any edge e = (f , u;) in the shortest 
path network G e , d e = l w {9) - l v (9) - q e {l v (9)). For any vertex v, l v {9 r ) = Ya=i l v ifii ~ Qi-l) + k(&o), 
and similarly q e {l v (&r)) = Yli=i 1e ~~ Hence, for any edge in the shortest path network at time 9 r , 

de = lw(6o) — h{Qo) + Z)i=i ~~ 4' ~~ ffe'l (^* ~~ ^i-i)- F° r edges not in the shortest path network at 

9 r , d e > l w {9 r ) - l v (9 r ) = l w (0 o ) - l v (0o) + YJi=\ (j l J ~ l v ~ 9e') (#i - Summing over all edges 

in path p yields 



r 

d P >T + J2(i?-il'-Qp) Wi-et-i) ■ 

Substituting in from Corollary [T31 and from Lemma [TT1 and since l' s (6) = 1, 



dp > T + ^ - T" " 1 " <?p (Ti - 



1=1 

Simplifying yields the desired result. □ 

Lemma 15. For a temporal routing game with J^pe-p fv = c o> tne completion times of the optimal flow and 
equilibrium flow are related as 

JL = 2l — L_ ( y Ti A i+1 -YLdA . (i2) 



The proof is based on the flow arrival rate at t for the equilibrium and optimal flows. For the temporal 
routing game in Figure |2l these arrival rates are plotted in Figure [3] and Figure [4] 

Proof. Consider the arrival rate at the sink for the optimal flow. For any path p G V, the rate of flow 
arriving at the sink increases by f p at time d p . The total flow arriving at the sink by time 9 is the area 
under this curve up to time 9. Thus, M = cqT — J2 P fpdp, and similarly for the equilibrium flow, M = 
c r EQ — YliZo T i^i+i- Equating these yields 

r-l 

cqT = c r EQ + f p d p - n A i+ i , 

pg-p i=0 

and dividing both sides by cqEQ yields the desired equality. □ 
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Figure 2: An instance of a tem- Fi g ure 3: Arrival rate at t for F i gure 4. Arrival rate at t for op- 
poral routing game equilibrium flow timal flow 

Using the lower bound in Lemma [141 and defining A r := c r — Co + ^ /p9p'> Ao := — fjj S P /pQp 
and for 1 < i < r - 1, A; := ^ £ p /p (ctfp ~ Ci+i<?p +1 ') , 

Corollary 16. For a temporal routing game with ^p£-p f p = cq, 

EQ ~ c c EQ^ o 

Lemma[[7]is used to partition the events into two sets, with events in the first set occurring at time 9 = 
and events in the second set occurring at time 6 r : 

Lemma 17. For < i < r and \i,yi 6 R, j/0 < 2/0 < 2/1 < ■ ■ ■ < 2/r> men J2i=o ^iUi — 2/r max^, 5^i=fe A*. 



By Lemma [171 3A; < r : X^i=o ^* r * — T r Yli>k Ai- Then since r r = -EQ, substituting in Corollary [T6l 



Evaluating ]T\> fc A i5 we obtain 52i>k A* = c r - c if fc = and Y,i>k A* = c r - c + ^ X] p Ulp if 
fc > 0. If k = 0, then ([13]) becomes > ^ - — (c r - c ) = 1 and hence in this case, f = EQ. If k > 0, 

£/ CQ CO " 

f Cr 1 / Cfe ? feM 

FQ c c y c ^ 1 J 

- 1 _ _A_ V f o fc ' 
(co) 2 ^ 

since by assumption, c e = / e on every edge. 
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Lemma 18. In any phase k of the equilibrium flow, J2 e c e9e' — c o l n - 

Proof Sketch. By the conditions of Theorem [5] and the definition of c e q^ = x^(l — yfr) and hence 
E e c e ?e = Ee=(«,«;) x e \} ~ tj) = X p ^2e=(v,w)e P ( x ~ jfc) for apath decomposition {x£ } peP 

of x fe '. We then show that for any s-t path p, Ee=(« iu)ep ~~ jfc 7 ) — m = m Lemma ITTI Since 
J2 P eV x p = c o> tne resu lt follows. 

Proof of Theorem® Let u> = Ck/cQ. Then from (fT4l and Lemma [T8l -j^Q > 1 — wln^j. Let z = wln^, 

then z is maximized when w = 1/e. Hence, -J^ > 1 — 1/e = . Observing that is the inverse of the 
price of anarchy, completes the proof. □ 

Note that we did not use any properties of the optimal flow over time in our proof. Instead of the optimal 
flow over time, we could obtain the same results for any temporally repeated static flow, with / being the 
static flow. 
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A An Example 

We present a brief example to demonstrate an equilibrium flow over time. For the temporal routing game 
in Figure [2 M = 5.5, Co = 3, and each edge is marked (c e ,d e ). In the example, the equilibrium flow is 
calculated as follows. Given the shortest-path network and the set of edges with queues at the start of a 
phase, we choose the rate low x % so that there exist labels \ % v which satisfy the conditions of Theorem [5] 
Given the rate flow x % and the vertex labels l\ within a phase, the equilibrium flow within the phase can be 
obtained by (flOl ). A phase ends when either a path event or queue event occurs, or there is no more flow at 
the source. 

Phase 1 starts at 0q = and on every vertex v the label I v (9q) = 0. In this phase, edges e\ and e 2 are in 
the shortest path network. Thus x' e = cq = 3 on both of these edges. We use the conditions in Theorem [5] 
to obtain the rate of change of labels, given by l' s = 1, l' v = 3/2, and l' t = 3. Hence q' ei = 1/2, and 
q' e2 = 3/2. Phase ends when edge enters the shortest-path network, at 9\ such that lt{9\) — l s (0\) = 1, 
yielding 8\ = 1/2. The equilibrium flow over time can be calculated by (TTOT ). to obtain f^ihiO)) = 3, 

feM )) = = 2 ' feM G )) = 1 for G (0 O , 6 1 ). 

Phase 2 starts at 0\ = 1/2, and edges e±, e 2 and are in the shortest path network. The rate flow and the 
rate of change of vertex labels are again obtained by the conditions in Theorem [5] so that x' ei = x' e2 =3/2, 
and x' e4 = 3/2. Note that in this phase edges e\ and e2 had queues on them at the start of the phase, hence 
E\ = {ei,e 2 }. Then l' v = 3/4, and l' t = 3/2 and for the queues, q' ei = -1/4, q' e2 = 3/4, and q' e4 = 1/2. 
For G (0i,6 2 ) the equilibrium flow f+(l s (9)) = 3/2, feMO)) = f£(lv(0)) = 2, feM )) = X > and 
_f+(Z s (#)) = 3/2, fe 4 (lt(0)) = 1- Phase 2 ends when edge e% enters the shortest path network at 82 so that 
h(e 2 ) - l v (8 2 ) = 1, yielding 6 2 = 5/6. 

In Phase 3 all the edges are in the shortest path network. The queues do not change on any edge, and 
this phase continues until the completion time. In this phase x' ei = 2, x' e2 = x' ez = 1, and x' e4 = 1. On all 
vertices, the labels l' v = 1. 

The rate of flow arrival at the sink as a function of time for this example is plotted in Figure [3] 



B Proofs from Section 3] 



Proof of Lemma® The total delay of the earliest arrival flow is 



D((g + ,g-))= l T 0g+(9)d9 



T/2 rT/2 

e g +(e)d0- / 0gt(O)d6 
Jt 

T/2 r-T/2 



= 8g+(0)d0+ {T-4>)gt(T-4>)d4> (15) 

Jo Jo 

where the last inequality is obtained by substituting (p = T — 9. Since gf{0) is an increasing function of 

for <T,gf(T - 0) > gt (0) for 0<T/2, and hence 
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e g +(e) + (T-e) g +(T-e) > T/2( g +(9) + g +(T-9)). 

Replacing in (fT5T ). 

f T/2 

D((g + ,g-)) > / T/2(g+(9) + g+(T-9))d9 
Jo 

= MT/2 

since f Q T/2 (gt(9) + 9ti T ~ 9))d8 is the total flow arriving at t. □ 

C Proofs from Section \5\ 



Proof of Theorem \W\ The strategy for enforcing an equilibrium flow over time of total delay at most 
2e/(e — 1) times the total delay of the earliest arrival flow in general graphs is now exactly the algorithm 
described in the proof of Theorem|7] In particular, for an instance T instead of looking at the earliest-arrival 
flow which may have an exponential-sized description, we only need to consider the quickest flow which 
can be computed in polynomial time. The network manager, as the leader, then reduces the capacities of 
every edge to equal the flow on the edge in the static flow underlying the quickest flow. By Theorem [H the 
equilibrium flow obtained following the action of the leader has total delay at most 2e/(e — 1) times the 
minimum total delay of any flow in the original instance. □ 



D Proofs from Section [6] 

Proof ofU7\ Let x' and /' denote the rate flow and rate of change of vertex labels at time 9. For consecutive 
edges (u, v), (v, w) in p, x' uv = l' v fuv^v(9)) and x' vw = l' v f^w(lv(9)) by (flOl) . From the conditions of the 
lemma, it follows that x' uv = x' vw , and hence x' e = /+ 1 (9) for every edge in the path. 

The proof is by induction on the size of the path. For the base case, p is a single edge e = (s, v ). If e 
has a queue on it at time 9, then fe(l v (9)) = c e and l' v = x' e /c e = ff v {9)/fe(l v {9)), and hence the lemma 
is true. If e does not have a queue, l v {9) = l s {9) + d e , and hence l' v = l' s = 1. Since if e does not have a 
queue fe(l v (,9)) = /^(^), the lemma is true for the base case. 

Let p = (s, v i, V2, ■ ■ ■ , Vk) be a path in Go of length k and let e = (vk-i, Vk). If e has a queue on it at 
time (6*), then /^(^(fl)) = c e and V Vh = x'Jc e = f£ Vl (9)j 'f~ (l Vk (9)). If edge e does not have a queue 

t+ (i a (g)) 

on it, V = V = — — s " 1 — where the second equality follows from the inductive hypothesis. 

By the conditions of the lemma, / ! r_ 2t , fc _ 1 (Zu A _ 1 (^)) = ft(^v k ^ 1 (9))- Since edge e does not have a queue 
on it, f+(l Vk _A0)) = fc(lv h m and hence l' Vk = fgff D 

Proof of Corollary\l6\ From Lemma [141 and observing that ]T\ f p = cq, and by rearranging terms, 
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E u d p ^J2fp 



Cn 

pev peP L 4=1 



TV -^(1 + 4 J - {n-Ti-X 



c r r - - Ti-x)— E f p (l + q l p) 



4=1 C0 P£ P 



c r r 



E di ( Ti - t *-i) ~ E ~( Ti ~ r< - 1 ) E 

4=1 4=1 c ° P eP 



r-l 

C T r - C r T, r + Y r 4 A 4+l + T — 

4=0 C ° peP 



r-l 



^ E Atf + E^E/p O^ 1 ' - 



and hence, 



Cn ' — ' ' — ' Cn 

u p£T 4=1 u peP 



r-l 

Cl 



E -^p ~ E r * A '+i - c o r »- - c r r r + t — E ~ T r— E -^p' 
pgP 4=o c ° P eP C ° peP 

+ E^E^(^ 1 '-^') 



Cn 

4=1 U pGP 



Substituting A r = c r - c + ^J^pfpQp' A o = -|EpMp' and for 1 < i < r - 1, A.; 



^Ep/p(c4^'-Ci + l^ +1 ' 



E •W? ~ E Ti A * - ~ E XiTi ' ( 16 ) 

p£j> i=0 4=0 

and substituting (fTBT ) into Lemma [15] gives the result. □ 

Proof of Lemma [771 The proof is by induction on r. For r = 0, the lemma is satisfied at equality. Assume 

Y%=o A 42/4 < 2/r-i maxK r -i Ei>fc A 4- If Ei^o 1 A 4y4 < 0, then Ya=o ^iVi < ^rVr < Vr max fc < r Y.i>k A 4- 
If E[=o ^iVi > 0, then by the induction hypothesis, 

r-l 

< }XiVi < y r -x max Y^Aj 

z — ' fc<r— 1 L — ' 

4=0 _ 4>fc 

and hence maxfc< r _i J2i>k A « > ®- Thus 



E - Vr-i max E A * + 

* — * k<i — 1 *■ — * 

4=0 _ i>k 

< y r ( max > A; + A r ) 

JKr-1*— ' 

i>k 

^^?ifE A « 



k<r 
~ i>k 
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proving the lemma. 



□ 



Proof of Lemma[[8\ Since we now concentrate on a single phase k, we simplify notation and use x' e , l' v and 
q' e to denote the rate flow, rate of change vertex labels and rate of change of queue in phase k. E\ denotes 
the set of edges with strictly positive queues at the start of phase k. By definition for an edge e = (v, w), 
q' = I' — I' if e is in the shortest path network and q' = otherwise. Thus c e q' e = x'Jl — if-) since if e is 
not in the shortest-path network, q' e = x' e = 0. If e is in the shortest-path network and q' e = 0, l' v = l' w , and 
if q' e / 0, e G E 1 and hence x' e = c e l' w . Thus J2e c e<?e = J2e={v,w) x 'e ( X ~ 1^)- Let WpheP be a path 
decomposition of x' . Then 



e e=(v,w) V w/ p€P:e€p 

= E4 E f 1 -^)- (17) 

per e=(v,w)ep v w ' 
We bound Y^ e =(v,w)e P ( x ~ |0 for anv P atn P- Let P = ( s = v ,vi,v 2 , ■ ■ ■ ,vi = t), and y = 

^»( 1 -'fc)- The " 

^ fe) 2 ^ 

for i ^ 0,1 and hence y is maximized when l' v _ = ^Jl'v t _ J' Vt+1 - Note that by Lemma [H l' v {9) > for any 

v E V, 9 G R+. We know that ^ = 1, and by Lemma [TT] l' t = co/ck- Substituting these values in the 
expression for y yields 



y<l-irf) ■ (18) 

Let z = I — I ( a ) and a = — . Differentiating z w.r.t. /, 

= l_a 1 /i+ bio. 
ol I 

Hence, z is maximized when I — la 1 / 1 = a 1 / 1 In -. Then z = I — la 1 / 1 = a 1 / 1 In - < In ^ since a < 1. 
Substituting this in £[8]>, V < z < In Hence on any path p, ^ e= („ jU ,) e p f 1 — ) < In Substituting 
this in dTvT t yields 



V] c e q' e < S~] x' In — = Co In — . 
since the rate flow x' has value cq. □ 
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